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„ The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 

Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 

after SIX (6) MONTHS from the mailing date of this communication. 

I the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered t mely. 

- If NO S for ^specified above, the nucdmZ statutory period will apply and will expire SIX (6) MONTHS from ",ng da e ^f this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

tatus 

I) 13 Respond"* *" rnmmi miratinnfo filed on 01 February 2005. 
2a)l3 This action is FINAL. 2b)D This action is non-final. ' 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) |3 Claim(s) 1^8 is/are pending in. the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) 13 Claim(s) 1^8 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10)D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1 .121(d). 

I I) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12)13 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)l3 All b)D Some * c)D None of: 

1 . |3 Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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2) □ Notice of Draftsperson's Patent Drawing Review (PTO-948) Paper No(s)/Ma,l Date. 
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DETAILED ACTION 
Response to Arguments 

1 . Applicant's arguments filed 2/1 /05 have been fully read and considered but they 
are not persuasive. 

A Replacement Sheet of fig. 3 is approved. 

Regarding lines 7-8 on page 4 of applicant's remarks, applicant asserts that 
Korein does not teach a moving object tracking apparatus for detecting and tracking one 
or more moving objects which utilizes a single stationary camera. The examiner 
respectfully disagrees. Element 20 of Korein's fig. 1 is a single stationary camera. Also 
noted in col.6, lines 46-49, Korein discloses that the element 20 is mounted on the 
ceiling, so thus, camera 20 meets the broad definition of a single stationary camera . 
The fact that the camera 20 is mounted indicates that the camera 20 is stationary. Just 
because the camera 20 swivels does not mean that the camera 20 is not stationary, 
since the attachment of the camera Applicant needs to further define the single 
stationary camera to overcome the broadly written limitation of "a single stationary 
camera". 

Regarding lines 14-20 on page 5 of applicant's remarks, applicant state that the 
combination of Korein and Geng cannot obtain the present invention. The examiner 
respectfully disagrees. In response to applicant's argument that there is no suggestion 
to combine the references, the examiner recognizes that obviousness can only be 
established by combining or modifying the teachings of the prior art to produce the 
claimed invention where there is some teaching, suggestion, or motivation to do so 
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found either in the references themselves or in the knowledge generally available to one 
of ordinary skill in the art. See In re Fine, 837 F.2d 1071, 5 USPQ2d 1596 (Fed. Cir. 
1988)and In re Jones, 958 F .2d 347, 21 USPQ2d 1941 (Fed. Cir. 1992). In this case, it 
would have been obvious to one of ordinary skill in the art to combine the teachings of 
Kdrein and Geng, as a whole, for capturing omnidirectional three dimensional images to 
accomplish practical tasks, ie. object detection and tracking, that require simultaneous 
360 degree viewing angle and three dimensional measurement capabilities, as 
disclosed in Geng's col. 3, In. 1-4. 

Regarding lines 21-22 on page 5 of applicant's remarks, applicant mentions that 
Korein does not teach the stationary camera. The examiner respectfully disagrees. 
Element 20 of Korein's fig.1 is a single stationary camera. Also noted in col. 6, lines 46- 
49, Korein discloses that the element 20 is mounted on the ceiling, so thus, camera 20 
meets the broad definition of a single stationary camera . The fact that the camera 20 
is mounted indicates that the camera 20 is stationary. Just because the camera 20 
swivels does not mean that the camera 20 is not stationary, since the attachment of the 
camera Applicant needs to further define the single stationary camera to overcome the 
broadly written limitation of "a single stationary camera". 

Regarding lines 23-24 on page 5 and lines 10-1 1 on page 6 of applicant's 
remarks, applicant contends that Korein does not teach the image processing section 
which detects and tracks moving objects based on image information. The examiner 
respectfully disagrees. Element 106 of Korein's fig.1 is the computer that processes the 
captured image information. Also peruse col.11, ln.48 to col. 12, ln.6. And, in col. 12, 
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ln.37-41, Korein discloses that objects can be tracked, thus the object is detected. Also, 
in col. 13, ln.48-57, Korein discloses that motion detectors can be applied to the 
captured image information for tracking purpose. Thus, Korein meets the broadly 
recited limitation of "the image processing section which detects and tracks moving 
objects based on image information". 
Thus, the rejection is maintained. 

Claim Rejections - 35 USC § 103 

1 . The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
, forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 

the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

2. Claims 1 -6 are rejected under 35 U.S.C. 1 03(a) as being unpatentable over 
Korein (6,226,035) in view of Geng (6,304,285). 

Regarding claim 1 , Korein discloses a moving object tracking apparatus for 
detecting and tracking one or more moving objects in an environment, comprising: 

an optical system including a hyperboloidal mirror for capturing visual field 
information (col.9, ln.29-34; fig.1, note optical system 10 can replace the mirror 12 with 
a hyperbolic or hyperboloidal mirror for capturing visual field of the wide angle image 
data); 

a single stationary camera for converting the captured visual field information to . 
image information (fig.1, element 20); and 
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an information processing section for processing the image information (fig.1 , 
element 106 is the computer that processes the captured image information, col.1 1 , 
ln.48tocol.12, ln.6), 

wherein the information processing section detects and tracks the one or more 
moving objects based on the image information (col. 12, ln.37-41 discloses that objects 
can be tracked, thus the object is detected; and col. 13, ln.48-57, Korein discloses that 
motion detectors can be applied to the captured image information for tracking 
purpose). 

Korein does suggest that omni-directional imaging system can be constructed 
using a camera, a parabolic mirror and a telecentric lens (col. 9, ln.50-51), and also, 
that a hyperbolic mirror is used in Korein's wide-angle optical system (col. 9, ln.29-34). 
Although Korein does not specifically disclose hyperboloidal mirror for capturing visual 
field information on a 360 degrees environment, however, Geng discloses that a 
hyperbolic mirror can be used for capturing the visual field information omni-directional 
image data on a 360 degrees environment (see fig.4 and col.4, ln.29-37; note the 
omni-mirror can be a hyperbolic mirror to capture the omni-directional or all direction 
view or 360 degrees environment view of the scene, and that, the hyperbolic mirror is 
below the CCD camera to optimally capture images of a 360 degrees environment or 
panoramic scene). Therefore, it would have been obvious to one of ordinary skill in the 
art to combine the teachings of Korein and Geng, as a whole, for capturing 
omnidirectional three dimensional images to accomplish practical tasks, ie. object 
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detection and tracking, that require simultaneous 360 degree viewing angle and three 
dimensional measurement capabilities (Geng col.3, In. 1-4). 

Regarding claim 2, Korein discloses wherein: the image information includes all- 
direction image information (col.9, In. 50-56); and the information processing section 
converts at least a portion of the all-direction image information to panoramic image 
information (col .2, In. 6-1 1 and col.9, ln.50-56). 

Regarding claim 3, Korein discloses wherein the information processing section 
provides a marker to each of the one or more moving objects in the panoramic image 
information (col. 12, ln.65 to col. 13, ln.6 and col. 13, ln.39-45). 

Regarding claim 4, Korein discloses wherein the information processing section 
provides a marker to each of the one or more moving objects depending on a size of 
each of the one or more moving objects (col. 12, ln.65 to col. 13, ln.6 and col. 13, ln.39- 
45). 

Regarding claim 5, Korein discloses wherein: the image information includes all- 
direction image information (col.9, ln.50-56); and the information processing section 
converts at least a portion of the all-direction image information to perspective 
projection image information (col.2, ln.6-11 and col.9, ln.50-56, note panoramic image 
data produced is the perspective image information). 

Regarding claim 6, Korein wherein the information processing section processes 
the image information using a previously prepared table (col. 13, ln.58 to col. 14, In. 63; 
note Korein discloses that the image information can be obtained by using stored data 
in the tables, ie. the mathematical formulas for conversion processes of image data 
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from spherical coordinates to Cartesian coordinates, so that one can facilitate image 
reproduction). 

3. Claim 7 is rejected under 35 U.S.C. 103(a) as being unpatentable over Korein 
(6,226,035), Geng (6,304,285) and in view of Matsuda (5,953,449). 

Regarding claim 7, Korein and Geng do not specifically wherein the information 
processing section processes the image information using only one kind of data out of 
RGB data in the image information. However, Matsuda teaches the use of the RGB 
data from the image information to utilize and calculate color values during image 
processing (col. 9, ln.20-22). Therefore, it would have been obvious to one of ordinary 
skill in the art to combine the teachings of Korein, Geng and Matsuda, as a whole, for 
easily measuring color information of the RGB data in an accurate manner so as to 
enhance displaying image data (col.3, ln.59-64). 

4. Claims 8 is rejected under 35 U.S.C. 1 03(a) as being unpatentable over Korein 
(6,226,035), Geng (6,304,285) and in view of Lee (5,787,199). 

Regarding claim 8, Korein discloses a motion detector to detect the motion of a 
target (col. 13, ln.48-57). Korein and Geng do not specifically disclose wherein the 
information processing section detects the one or more moving objects based on a 
brightness difference between predetermined frame information and frame information 
previous to the predetermined frame information of the image information. However, 
Lee teaches wherein the information processing section detects the one or more 
moving objects based on a brightness difference between predetermined frame 
information and frame information previous to the predetermined frame information of 
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the image information (col.2, ln.62 to col.3, ln.7). Therefore it would have been obvious 
to one of ordinary skill in the art to combine the teachings of Korein, Geng and Lee, as 
a whole, for determining whether the object belongs in the foreground or background 
region, and for clearly distinguishing the objects within a picture (Lee col.1 , ln.54-56). 
Doing so would improve the encoding of the image information while maintain high 
image quality and accuracy. 

Conclusion 

5. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .1 36(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Contact Information 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Allen Wong whose telephone number is (571 ) 272-7341 . 
The "examiner can normally be reached on Mondays to Thursdays from 8am-6pm 
Flextime. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Christopher Kelley can be reached on (571 ) 272-7331 . The fax phone 
number for the organization where this application or proceeding is assigned is 703- 
872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PA|R or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-21 7-91 97 (toll-free). 
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Art Unit 2613 
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